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Inevitable irreversibility in a quantum system consist- 
ing of many non-interacting "small" pieces 

Hal TasakiQ 

Abstract 

We review the recent result of Sato, Sekimoto, Hondou, and Takagi ( |cond- 
mat /000839^ ) on the irreversibility inevitably observed in systems consisting of many 
non-interacting "small" pieces. We focus on quantum models, and supply an explicit 
lower bound for the work required to complete a cyclic process. 

1 Introduction 

In statistical physics textbooks, one often encounters systems which consist of macroscopic 
numbers of identical small parts which do not interact with each other. This is not too 
unrealistic since there are many physical systems (such as certain spin systems, including 
nuclear spin systems) which are well approximated by such non-interacting models in some 
ranges of temperature and time. 

The question that we wish to examine here is the following: Does a system which 
consists of many non-interacting pieces behave as a "healthy" thermodynamic system? It is 
evident from exercises in statistical physics that the answer is "yes" when only equilibrium 
properties are concerned. If one focuses on certain non-equilibrium aspects, however, 
the situation may be different. In fact Sato, Sekimoto, Hondou, and Takagi recently 
proved that, in a system which consists of many non-interacting small parts, a simple 
quasi-static process involving contacts with two heat baths can never be reversible in 
general. It is remarkable that such a system fails to provide us with reversible processes, 
which are among the building blocks of conventional thermodynamics^. Sato, Sekimoto, 
Hondou, and Takagi then raise an interesting question whether one can develop a new 
thermodynamic framework which is capable of describing these unavoidable irreversible 
processes. 

The basic idea of Sato, Sekimoto, Hondou, and Takagi is indeed quite simple. Suppose 
that a small piece (whose identical copies form the whole system) is a quantum system with 
n energy levels ei, . . . , £„. We first assume that the whole system is in equilibrium with a 
heat bath at inverse temperature /3. Then the probability of finding the small system in 
the i-th state is Pi = e~^'^'^ / z{l3) where z{l3) is the partition function for the small system. 
We then gently decouple the system from the bath in such a way that the small system 
is still described by the same probability pi. Then we change a parameter in the model 
Hamiltonian very slowly, modifying the energy levels to e'^, . . . , e^. The adiabatic theorem 
tells us that, if the parameter change is sufficiently slow, the probability of finding the small 
system in the i-th state is still given by the sameQpj. But this Pi cannot be represented 
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in the Gibbsian form pi = e~^'^i / z'{l3') for any /?' unless the two energy levels 
and e[, . . . ,e'^ satisfy a special condition. (See ( p.l4|) .) Therefore if the system is brought 
into a contact with a heat bath after the operation, something nontrivial (which turns out 
to be a jump in the entropy) must take place, no matter how carefully one chooses the 
temperature of the bath. 

Of course such a mechanism applies to any quantum systems, including truly macro- 
scopic ones. But it is wellknown that this kind of deviation from a certain equilibrium 
distribution is irrelevant in thermodynamic limits. A crucial observation of Sato, Seki- 
moto, Hondou, and Takagi's is that the smallness of each non-interacting piece makes this 
deviation thermodynamically observable. 

If one regards non-interacting systems as models of more realistic weakly-interacting 
systems, then the above irreversibility of Sato, Sekimoto, Hondou, and Takagi should be 
observed only for operations which take place in a time interval which is not long enough 
for the system to redistribute its energy between the small parts. If the operation is 
slow enough and such a redistribution takes place, then the probability distribution for 
each part at the end of operation becomes essentially Gibbsian, and the process may be 
reversible. 



2 Setup and main results 

We consider a quantum system which consists of identical "small" quantum systems 
which do not interact with each other. A single small system has an ra-dimensional Hilbert 
space, and the whole system has an nA^-dimensional Hilbert space. 
The initial Hamiltonian of the system is 

N 

H = Y.K (2.1) 

i=l 

where, for all hi is identical to a certain Hamiltonian h for the small system. Initially 
the system is in touch with a heat bath, and hence in the Gibbs state 

^...^Gibbs ^^^^^___^^Gibbs|^ (2.2) 

with 

We gradually decouple the system from the heat bath, making it thermally isolated. 
We assume that the state of the system is unchanged from (|2.2| ). 

We then perform a "classical" operation on the system. This corresponds to an adia- 
baticQ process in thermodynamics. We model the operation by a time dependent Hamil- 
tonian 

N 

H{t) = Y.hm. (2.4) 

i=l 

^ Note that the word "adiabatic" means that no "heat" is exchanged between the system and the 
outside world, and does not mean anything Uke "slow and gentle." 
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Figure 1: Sato, Sekimoto, Hondou, and Takagi considered the following cycle; (a) A 
macroscopic system is in touch with a heat bath at inverse temperature (3. Th state of the 
system is described by a density matrix pi. (b) One gently decouples the system from the 
heat bath, without changing its state, (c) An external agent performs an operation on the 
system, changing its Hamiltonian from H to H' . The state changes to which may not 
be Gibbsian. (d) The system is put into contact with a heat bath at inverse temperature 
j3' . Here j3' is carefully chosen so that there is no net exchange of energy between the 
system and the bath. Note that this is a very innocent thermal contact, which causes no 
observable effects in normal thermodynamic systems, (e) Again one gently decouples the 
system from the heat bath, without changing its state, (f) The external agent performs 
an operation on the system, bringing back its Hamiltonian from H' to thus completing 
a cycle. 

Let Wcyc be the total work done to the system by the external agent during the above 
cycle. Conventional thermodynamics tells us that VFcyc can be made arbitrarily small by 
performing the operation slowly and gently. When the system in consideration consists 
of many "small' parts which do not interact with each other, however, Sato, Sekimoto, 
Hondou, and Takagi proved that IVcyc is always greater than a finite value. This means 
that the above thermodynamic cycle is inevitably irreversible. 
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where all hi{t) are identical. After the operation, the Hamiltonian settles to 



N 



H' = Y.K. (2.5) 

i=l 

where all h'^ are identical to h' . We denote by U the unitary operator which describes 
the quantum mechanical time evolution during the whole operation^ Since the system is 
thermally isolated, its state after the operation is simply given by 

(■■•)2 = Tr[(-->2], (2.6) 

with 

P2 = Up'{^'°'U-\ (2.7) 

Note that in general this is not a Gibbs state. 

Next we put the system into a contact with another heat bath with the inverse tem- 
perature (3' . After equilibration, the state of the system becomes another Gibbs state 

(■■■)5^^^^^ = Tr[(---)pr''l, (2.8) 

with 

Here the inverse temperature is (carefully) chosen so that 

{H'), = (i/')^^^^^ (2.10) 

holds. This means that there is no net exchange of heat between the system and the 
second heat bathQ This thermal contact thus looks quite innocent. We stress that for a 
normal thermodynamic system, such a thermal contact without energy exchange produces 
no observable effects. It is a peculiar nature of systems which consist of non-interacting 
small pieces that such a contact inevitably leads to irreversibility. 

Finally we repeat the same process backwards. We first gently decouple the system 
from the heat bath (without changing the state of the system), and then make an arbitrary 
operation which brings back the Hamiltonian from H' to the initial H. By denoting U' the 
unitary operator for this time evolution, we can write the final (generally non-Gibbsian) 
state as 

(■■■), = Tr[(.--)p4], (2.11) 

with 

P4 = U'pf^^'U'-\ (2.12) 

^ The unitary operator U is formally defined as follows. Suppose that the operation is done during 
t = to and ti. Let U(t) be the solution of the Schrodinger equation idU(t)/dt = H{t) U{t) with the initial 
condition ?7(to) ~ 1. Then U = U{ti). In what follows, however, we only use the fact that U is unitary. 

^ Because the Hamiltonian (2.5) is a sum of mutually commuting pieces, the fluctuation of the energy 

V Gibbs 



is 0{wN) in the states (• • and (• • . Since the expectation values of the energy itself is 0{N), 

this means that the fluctuation of energy is simply negligible for large enough N. 
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From the energy conservation law, one sees that the difference {H)^ — (H)^^ ^ is 
the total energy supplied to the system during the operation. In sufficiently large systems 
where the energy exchange between the second heat bath and the system is negligible, this 
difference is the total work done to the system by the outside agent (who performs the 
operation). Note that, from a thermodynamic point of view, the two operations together 
form a cycle because the Hamiltonian finally returns to the initial one. One of the basic 
assumptions in conventional thermodynamics is that the work during such a cycle can be 
made as small as possible by performing the operation slowly. The limiting operation in 
which the total work is vanishing is usually called a "reversible" cycle. 

But the following theorem due to Sato, Sekimoto, Hondou, and Takagi clearly shows 
that a reversible cycle is never realized in a system which consists of non-interacting small 
pieces. 

Theorem (Sato, Sekimoto, Hondou, and Takagi) For any unitary operators (which are 
consistent with the given initial and the final HamiltoniansQ) U and U', one has 

{H),-{H)f'''''>NAe{(3;h,h'), (2.13) 

where e{P; h, h') depends only on (3 and the energy levels £i, . . . , e„ and 5']^, . . . , of the 
Hamiltonians h and h' , respectively. The quantity e{f];h,h') is nonnegative in general, 
and is strictly positive unless 

Ei-Ei = A{e[-e[), (2.14) 

for any i with a constant A. 

For an explicit form of Ae{f3, h, h'), see ( [4.40|) . 



3 Example 

Simple (and probably realistic) examples are paramagnetic spin system. Note, however, 
that we do not expect the irreversibility due to the "smallness" in a paramagnetic S" = 1/2 
system, where the small system has only two levels. 

The simplest example is the S = 1 model under external magnetic field H with a 
crystal field anisotropy D, whose Hamiltonian is 

N 

H = Y.{-HSl'^-D{Sl'^r}. (3.1) 

i=l 

Here S'}^'* is the spin operator with three eigenvalues +1, 0, and —1. Thus each small 
system has three energy levels —H — D, 0, H — D. 

As in the standard adiabatic cooling experiments, we thermally isolate the spin system, 
and change the external magnetic field H. We find that the condition (|2.14|) is satisfied 



when D = 0. Thus we expect that the irreversibility due to the smallness of non-interacting 
pieces is observable when \D/H\ is sufficiently large. 

^ See footnote ||. 
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4 Proof 



4.1 Proof of the main theorem 

We prove the main theorem by applying the ideas of Sato, Sekimoto, Hondou, and Takagi 
to quantum models. We stress that our argument is a straightforward implementation of 
that of Sato, Sekimoto, Hondou, and Takagi's. The main points in the proof are the use 
of Gibbs-like entropy ( [4 .21) , ( [4 .31 ), and the representation ( [4 .131 ) of the entropy increase as 
a relative entropy. 

Throughout the present section, we only treat a special (and unphysical) case with 

= 1, i.e., a single small system. Since the small systems do not interact with each 
other, results for = 1 immediately implies the corresponding results for general N. 

For i = 1, . . . , n, let \ipi) and \ip'j) be the normalized eigenstates of h and h', respectively. 
We denote by £j and e[ the corresponding energy eigenvalues. We number the eigenstates 
so that Ei < Ei+i and e[ < e'^^-^ hold. 

Let us define a unitary operator U by 

U\^^) = (4.1) 

for alH = 1, . . . , n. The adiabatic theorem in quantum mechanics guarantees that the time 
evolution is described by this unitary operator when the operation is executed infinitely 
slowly (and if one tunes the phases of the basis states properly). We note that, in usual 
macroscopic quantum systems, an operation must be unphysically slow for the adiabatic 
theorem to be relevant. In the present case of systems consisting of non- interacting small 
systems, however, the slowness required by the theorem may be physically realized since 
each small system evolve independently. 

Once we prove the desired bounds for the special unitary transformation U, the same 
bounds for arbitrary U (and U') follow immediately. This is because for given h, 
h', and f3, the energy {h')^ after the first operation for arbitrary U (consistent with the 
Hamiltonians h and h') does not exceed the same quantity obtained from the unitary 
operation (|4.1|) . (This is nothing but the minimum work principle.) The same is true for 
the second operation which brings back the Hamiltonian from h' to h. Therefore we shall 



only concentrate on U defined by (j^A 



Let us define the Gibbs-like entropy with respect to Hamiltonian h as^ 

n 

Sh[p] = -kJ2{^i\p\Vi) ^og{(pi\p\(pi), (4.2) 



i=l 



and the entropy with respect to h' as 

Sh'lp] = -kj:{^[\p\^[) \og{^'M^';). (4.3) 



i=l 



^ Note that the present definition of entropy depends on the choice of Hamiltonian h, while the Gibbs 
entropy (and the von Neuman entropy) does not depend on Hamiltonians. In this sense, the present 
definition is closer (in spirit) to the Boltzmann entropy, which depends on the way of characterizing the 
system from a macroscopic view point (e.g., by using energy). 
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Since the initial state (■ ■ .^^''^^'^ is Gibbsian, we write down the density matrix exphcitly 

as 

p—f3h n 

p'r'''' = .f^^=E\^.)p^{^.l (4.4) 



where 



= = (4.5) 



Thus, from the definition ( |4.2| ) of entropy, we find 

n 

'S'/.[pf'"'l = -kJ2pr\ogp, = k(3 {h), + k \ogz{(3). (4.6) 



i=l 



By using ( [4. 41) and ( [4.1|) , we find that the density matrix after the first operation is 
simply written as 

n 

P2 = Upf'^'^^U-'=Y.W,)p,{^'l (4.7) 



i=l 



with the same pi as in ([4.5|) . We therefore find from ( [4.3|) that 

n 

5h'[P2] = -kY^pdogpi = 5,[pf'"^^]. (4.8) 
j=i 

Our entropy is invariant under slow operation. 

We then examine the next Gibbs state (■ • .^^^^'^'^ obtained by letting the system interact 
with the second heat bath. Its density matrix is simply 

—f3'h' n 

pf''' = ^^^^=Ey^)p'A^^i (4-9) 

where 

—/3'e' n 

K = ^^ .'(/?') = Ee-^'< (4.10) 
Recall that the inverse temperature /?' is determined from the condition 

{h% = {h')f'''\ (4.11) 
From the definition (|4.3|) of the entropy, we have 



i=l 



k(3{h')f''''' + k\ogz'{(3') 
k(3 {h')^ + k log z' {(3') 

n 

kf3Y,pAe[ + k\ogz\(3')} 

i=l 
n 

-kJ2p,\ogp'„ (4.12) 

i=l 

7 



where we used ( [4 .111 ) and ( |4.7| ). Combining this with ( |4.6| ), we find that the difference of 
the two entropies can be represented in a remarkable manner as 

n I 

Sy[p^^''^] - 5,[pf^^1 = -kY^pdog"^, (4.13) 

7^1 Pi 

where the right-hand side is nothing but the relative entropy. From the wellknown property 
of relative entropies, we find^ 

Sh'[p2'^''']-Sh[pf''''']>^. (4.14) 

Here the equality holds only when = p[ for all i. By examining the explicit formulas 
( [4.5[ ) and ( [4.1 0| ) of pi and p[, respectively, one finds that this is possible only when the 
energy levels satisfy the condition (|2.14|) . 

As for the second operation (which brings back the Hamiltonian from h' to h), we 
assume that the time evolution is described by the unitary operator U~^. We repeat the 
same argument to show 

^/.[p4] = 5/.'[pf''l- (4.15) 

As a theoretical reference, we define yet another Gibbs state (■ ■ with the density 

matrix 



P5^'''^ = T^T-^,. (4.16) 



e 



Tr[e-/^"^ 

where (3" is determined by the condition 

(/^)r'^= ^4- (4.17) 

Then exactly the same argument as before shows 

5',[pf^^V'5/.'[p^^""1 >0. (4.18) 

From (|rT4D and (|4rT8| ), we finally get 

'5/^[pf''1-^h[pf'''1>0, (4.19) 

where the equality holds only when the condition (|2.14| ) is satisfied. Since (. ■ and 
(■ ■ .^^'^^^ are the Gibbs states for the same Hamiltonian h with the inverse temperatures 
/3 and respectively, ([4.19|) implies that 

13" < 13, (4.20) 

and hence 



(/,)^= (/i) Gibbs > Gibbs _ ^4 21) 



9 Proof: Since log a: < a; - 1, one finds (L.H.S.) > -fc EILi - 1} = kTJl=i{Pi ~ P'i) = 0- To 

show that the equahty holds only when pi ~ p[ for all i, it suffices to note that logx < x — 1 whenever 
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Again the equality holds only when the condition ( |2.14| ) is satisfied]^. This proves the 
desired theorem since, for the present choice of unitary operator U, the quantity {h)^ — 
{h)^ ^^^^ clearly depends only on /3, ei, . . . , £„, and e'^, . . . , e^, and has been shown to be 
strictly positive unless ( ^^.141 ) hold^. 



4.2 Explicit lower bound of the work 

We stress that the argument of Sato, Sekimoto, Hondou, and Takagi presented in the 
previous subsection indeed proves the strict inequality 

{h)^ - > 0, (4.22) 

for any h and h' which do not satisfy the condition ( |2.14| ). But it might be desirable 
to have an explicit positive lower bound for the required work {h)^ — (/^,)^^^^^ Let us 
construct a simple lower bound here. 

We start from the representation ( [4.13|) of the entropy difference, and rewrite it as 



n 



n 



Pi 

P\\ .Pi 



'V P^J Pi 



i=l 




^Ep^4-)' (4-23) 



i=l 



yPi 



where 



g{x) = X — 1 — \ogx. (4.24) 



Note that g{x) > for any a; > and g{x) > if x 7^ 1. 

Let us first treat the simplest nontrivial case with n = 3, i.e., a three level system. Let 

di = £3-£i, d2 = e3-e2, d[ = e'^-e[, 4 = 4-4- (4-25) 

Then for pi and as in ( ^75| ) and ( [4.10| ) , we have 



= exp\-(3di + (3'd[], = exp\-(3d2 + (3'd']. (4.26) 

Pi P3 P2 
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It can be shown easily that the equahty indeed holds when we have the condition ( p.l4| ) and the 



time evolution is described by the special U and defined by (O). For a general time evolution, the 
equality may be violated for any Hamiltonians, but this is of course the usual irreversibility. 

We note that the above proof can be directly applied to classical systems. To do this, we fix a 
constant S > 0, and (as in [^) decompose the whole phase space into slices with the same volume 5. The 
slices are determined so that the points in the i-th slice have initial energies between Si and £i+i. We 
prepare similar decomposition for the final energy as well. Then we let pi be the probability that the 
initial state is found in the i-th. slice. If we perform the operation slowly, one finds that, in the final state, 
the probability that the state is in the i-slice (in the decomposition according to the final energy) is still 
given by pi. (We only use the adiabatic theorem.) Then we can simply repeat the above proof. By taking 
the limit (5^0 finally, the desired proof for classical systems follow. 



9 



Introducing vectors d = {di, ^2) and d' = {d[, d'2), we observe that 



niin|/3d-/5'd'| = PD{d,d') 



where 



D(d.d') 



>\2 



fdd 



IdPld'p- 



(4.27) 



(4.28) 



Note that D{d, d') is vanishing if d and d' are proportional, and is strictly positive other- 
wise. From (|4.27| ) we see that 



\Pd,-P'd[\ > 



PDid,d') 
V2 



(4.29) 



for at least one of i = 1 or 2. From this bound we can show that, at least for one of 
i = 1,2, 3, we have 

Pi 



log- 



Pi 



> 



JL 

2^/2 



D(d,d'). 



(4.30) 



To see this, suppose the contrary, i.e., | log(p-/pi)| < l3D{d,d') / {2\/2) for all i. Then for 
i in (ICTI ) 



1 Pi 
log — 

Pi 



log— — + log — 

P3 Pi P3 

-pdi + (3'd\ + log 



> \l3d,-l3'd[\- 



log 



P3 
P3 



> 



D(d,d') 



(4.31) 



which is a contradiction. We have here used ( ^4.261 ), ( [4. 29] ), the triangular inequality, as 
well as the assumption ( [4.30|) . 

Let i be such that ([4.30|) is valid. Since g{x) is increasing in x for x > 1 and de- 
creasing in X for a; < 1, we find that g{p'i/pi) is bounded from below by the smaller of 
g{exp[i3D{d,d')/{2V2)]) and g{exp[-l3D{d, d') / (2^2)]). Since the latter is smaller, we 
have 



P: 



9{-] >-^D{d,d')+exp 



yPi 



2V2 



2V2 



Did, d') 



- 1 > 0. 



(4.32) 



By using the representation (|4.23|) , we can bound the total entropy difference as 



Sh'ipf"""] - S^ip^"^'] >kp,g{^\>kpsg\ 



Pi 



.Pi 



Pk 
.Pi, 



(4.33) 
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By combining this with ( |4.18| ) andQ using ( [4.32| ) , we get an exphcit bound for the entropy 
increase^ 



5.[pf - S,[P?''''] > ^ {^^(d, d') + exp 



2^2 



1} >0. (4.34) 



We can use the same estimate to treat models with general n. Let M be the smallest 
integer which does not exceed n/3. For each m = 1, . . . , M, we choose three integers 1 < 
£i{m) < i2{fn) < ^3(^) < n, in such a way that each z = 1, . . . , n is chosen at most oncej^. 
Then by using the previous estimate for the levels Si, e[ with i = £i{m) , i2(y^) , ^si^n) , we 
get 



5.[pr''l-5.[pf^'^1 > E |^D(d^,dJ+exp 



2^2 



-1| >0, 
(4.35) 

where 

dm = i^isim) — Qi(m),^£3(m) " ^£2(m))' (4.36) 

and 

dm = i^isim) " ^h(m)^^tz(m) ~ ^£2(m))- (4.37) 

It is clear that whenever the energy levels e^, e'^ do not satisfy the condition ( 2.14| ), one 
can choose li{m) in such a way that -D(dm, d^) > for at least one m. 

Finally, we note that the entropy and the energy in the Gibbs state for the Hamiltonian 
h aX a. general inverse temperature (3 satisfies the wellknown relation 

^^^(pir)=^/3^wir- (4.38) 



Dividing this relation by — and integrating it from 13" to /3, one finds that 



1 



kf3 J 13" [ d/3 



^{5/.[p^'''1-^/.[pf'''1}- (4.39) 

Although we can construct a lower bound for S"?! [p^'''''''] — Sh/lp^^^""^] in the same manner, i t wil l 
depend on (3' and won't be an explicit bound as it is. Therefore we simply use the weak inequality ( [1.18 ) 
for the second operation. 

""^■^If one prefers a bound which include only simple functions, one may use 



f.Gibbsi „ r.Gibbsi . f |_{^(d, A')Y if PD{d, d')/{2V2) < (4/3) 

^ '^^^ m \^^D{d,d')-l if/3i?(d,d')/(2V2)>(4/3), 



which is obtained from (4.34) through elementary estimate. 
A simple choice is £i{m) = 3(m — 1) + i. 
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By substituting ( |4.35| ) and recalling ( |4.17| ), we get our final estimate for the irreversible 
work 



M 



\ /3zi/3) \2V2 



D(d„,d^) +exp 



(4.40) 



We stress that the bound (^4.40 ) is far from optimal. In the crucial estimate ( [4.27 ), 
for example, we are simply looking for (3' which minimizes the distance between (3d and 
/3'd'. But the true (3' is determined from the condition ([4.11|) about the balance of energy, 
which condition is not taken into account in our bound. 

It is a pleasure to thank Ken Sekimoto for useful discussions and for letting me know 
of the results in [0] before making them public. 
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